brings reader panels in to review the proposals. These readers try to apply the criteria set up in the ESAA application process to the proposals. These readers are often ESAA program officers from other LEAs and from SEAs. Again, these readers are unlikely to have any knowledge of evaluation. Neither readers nor program officers often understand the sophisticated set of criteria originally established for ESAA. For example, the original guidelines called for awarding points on the basis of well-developed objectives. Specific percentages were mentioned as desirable. At least regionally this was eventually interpreted as "the more percentages the better." This eventually led to such meaningless objectives as "10% of a 10% sample of high school students will score 75% on a measure of involvement" I Our office was told at one point that a comparison based on a significantly higher performance of a program group over a control group was unacceptable.
In the early 1970s, the Austin ISD did try meaningful evaluation in ESAA programs several times. We had budgets of as much as $84,000 for a program with a budget of $840,000 for the ESAA bilingual component.  (At one time, Austin had three large ESAA programs: basic, pilot, and bilingual, so that the annual ESAA program budgets totalled almost $2 million.) More recently, as the impact of Austin's last court order on desegregation declined, funding declined as well, and evaluation budgets fell more drastically than program budgets. Thus, for the last three years, the evaluation/program budgets for ESAA basic (the only component remaining in Austin by last year) have been respectively: $3,000 and $163,970 in 1979; $12,000 and $414,255 in 1978; and $5,400 and $488,900 in 1977. The drastic decline in the evaluation budget from the early years to 1977 was due to a regional, or perhaps national, interpretation of the legislation that a set-aside of 1 percent for national evaluation was a limit on local evaluation as well. Of course, there is a considerable difference between what can be done with 1 percent nationally and what can be done with 1 percent of a small local budget. Any true evaluation of local ESAA became impossible even when that evaluation was merely the mandated measurement of objectives set out by the SEA. Such objectives had to be carefully written around what could be measured by using existing district data, whether they had a stronguation activities not affect staff characteristics:             oti
